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(54) Solid state color imaging 
apparatus 

(57) In a solid state color imaging 
apparatus comprising photo sensitive 
element arrays arranged horizontally 
and vertically, means for reading out 
simultaneously video signals of the 
photo sensitive element arrays on two 
horizontal lines and delivering the read 
out video signals via terminals 9, 10 to 
first and second output circuits, and a 
mosaic color filter, Figure 5, disposed in 



front of the photo sensitive elements 
and having luminance filtering counter- 
parts arranged horizontally and vertical- 
ly on- after the other and two types of 
color filtering counterparts arranged at 
the remaining positions and on alter- 
nate horizontal lines, the horizontal 
clock from the reading out means hav- 
ing a frequency of 7.16 MHz so that 
color difference signals having the 
chrominance subcarrier component of 
3.58 MHz are directly obtained in the 
first and second output circuits. 



FIG. 5 
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SPECIFICATION 

Solid state color imaging apparatus 

5 This invention relates to solid state color imaging 
apparatus and more particularly, to a solid state 
color imaging apparatus wherein a signal proces- 
sing circuit is simplified which converts output 
signals from photo sensitive elements arranged 
10 two-dimensionally in a solid state imaging device 
into an NTSC composite color signal. 

Recently, active development and research has 
been directed to a color television camera of the type 
which utilizes a single state imaging device because 
15 it is compact and light and is expected to be 
inexpensive. 

The solid state imaging device includes a large 
number of photo sensitive elements such as for 
examle photodiodes arranged horizontally and ver- 
20 tically and a color filter covering surfaces of the 

photo sensitive elements and having red, green and 
blue color filtering counterparts in register with the 
respective photo sensitive elements. When the 
photo sensitive elements are scanned, video signals 
25 corresponding to the color filtering counterparts 
covering the surfaces of the respective photo sensi- 
tive elements are successively delivered out from 
the single solid state imaging device in accordance 
with the order of the scanning. 
30 In a known solid state color television camera 
according to the prior art, red (R), green (G) and blue 
(B) signals delivered out from the solid state imaging 
device are respectively passed through associated 
processing circuits and encoder circuits and then put 
35 together to form an NTSC composite color signal. 
The processing circuit has to include at least a 
clamping circuit for fixing the DC component of the 
R, G or B signal, a blanking signal insertion circuit 
and a clipper circuit, and a highly precise tempera- 
40 ture stability is required of the processing circuit in 
order to maintain the color balance. The encoder 
circuit includes at least a matrix circuitfor deriving a 
luminance signal (Y) and color difference signals 
(R-Y, B-Y) from each of the R, G and B signals, low 
45 pass filters and balanced modulators for deriving a 
chrominance subcarrier signal from the R-Y and B-Y 
signals. Therefore, in the prior art solid state color 
television camera, the processing circuit of the 
output signals from the solid state imaging device 
50 requires a large number of circuit components, 

resulting in a complicated circuit construction which 
prevents cutdown in the manufacture cost. 

Accordingly, it is an object of this invention to 
provide a solid stae color imaging apparatus which 
55 can convert color video signals delivered out from a 
single solid state imaging device into an NTSC 
composite color signal with a simplified processing 
circuit. ; 
According to the invention, the above object can 
60 be accomplished by providing a solid state color 
imaging apparatus comprising a plurality of photo 
sensitive element arrays arranged horizontally and 
vertically; a signla reading out circuit scanning the 
plurality of photo sensitive element arrays with 
65 parallel scanning of the photo sensitive elmeent 



arrays arranged on sets of two horizontal lines and 
- delivering photo signals from the photo sensitive 
elements to first and second output circuits associ- 
ated with the two horizontal lines of the respective 

70 sets; a mosaic color filter having luminance filtering 
counterparts arranged horizontally and vertically 
one after the other and first and second filtering 
counterparts arranged at the remaining positions of 
the mosaic and on alternate horizontal lines, each of 

75 the filtering counterparts being in register with each 
of the photo sensitive elements; and a signal 
processing circuit for converting the signals de- 
veloping on the first and second output circuits into 
a composite color signal combined with a chromi- 

80 nance subcarrier, characterized in that the signal 
reading out circuit includes means for scanning the 
plurality of photo sensitive element arrays at a 
horizontal clock frequency which is twice the chromi- 
nance subcarrierfrequency, whereby a first color 

85 difference signal between a first chrominance signal 
corresponding to the first filtering counterpart and a 
luminance signal is delivered to the first output 
circuit whereas a second color difference signal 
between a second chrominance signal correspond- 

90 ing to the second filtering counterpart and the 

luminance signal is delivered to the second output 
circuit, the first and second color difference signals 
varying at the same frequency as the chrominance 
subcarrier frequency; and that the signal processing 

95 circuit includes bandpass fitters respectively con- 
nected to the first and second output circuits, first 
means for shifting by nil the phase of the output 
signal from one of the bandpass filters and adding 
the phase-shifted signal to the output signal from the 

100 other bandpass filter, second means for fetching a 
luminance signal componentfrom the first and 
second output circuits, and third means for forming 
a composite color signal from the outputs of the first 
and second means and a synchronizing signal: 

1 05 With the construction of this invention set forth 
above, by determining the light transmittivity of the 
respective filtering counterparts of the mosaic color 
filter such that the magnitudes of the output photo 
signals of the corresponding photo sensitive ele- 

110 ments are identical when a black and white object is 
picked up, the first and second color difference 
signals can be delivered out as balanced modulation 
waves, thereby eliminating necessity of providing 
balanced modulators in processing circuits for these 

115 color difference signals. 

Additionally, according to the invention, in place 
of adjusting the white balance by varying the light 
transmittivity of each filtering counterpart, the lumi- 
nance signal may be separated from the first and 

120 second chrominance signals and the magnitude of 
each signal rnay be so adjusted electrically as to 
obtain the balanced modulation wave. 

The foregoing and other objects, advantages, 
manner of operation and hovel features of the 

1 25 present invention will be understood from the 

following detailed description when read in connec- 
tion with the accompanying drawings, in which: 

Figure 7 is a circuit diagram of one example of a 
solid state imaging device which is applicable to an 

130 imaging apparatus of the invention; 



Figure 2 illustrates in sections A through H the 
wave forms of driving signals in the circuit of Figure 
1; 

Figure 3 is a partial plan view showing a prior art 
5 mosaic color filter combined with the solid state 
imaging device of Figure 1 ; 

Figure 4 is a block diagram of a prior art signal 
processing circuit adapted to process the output 
signals from the solid state imaging device of Figure 
10 1; 

Figure 5 is a partial plan view showing one 
example of a co|or filter combined with a solid state 
imaging device in accordance with the present 
invention; 

15 Figure 6\s a block diagram of one embodiment of 
a signal processing circuit in a solid state imaging 
apparatus in accordance with the present invention; 

Figure 7 is a block diagram of another embodi- 
ment of the signal processing circuit of the inven- 

20 tion; and 

Figure 8 is a partial plan view showing another 
example of the color filter combined with the solid 
state imaging device in accordance with the inven- 
tion. 

25 For clarity of the difference between the present 
invention and the prior art, a prior art solid state 
color imaging apparatus will first be described with 
reference to Figures 1 to 4. 

Shown in Figure 1 is a solid state imaging device 
30 as proposed in Japanese Patent Application No. 
82965/'77, which has been laid open as Japanese 
Patent Kokai No. 37427/'79, corresponding to US 
patent application Serial No. 923982 and assinged to 
the same assignee as the present application. This 
35 solid state imaging device is exemplified herein as 
applicable to a solid state color imaging apparatus of 
the present invention. 

The solid state imaging device comprises a plural- 
ity of photo sensitive element and MOS.type ele- 
40 ment arrays wherein the arrays on the n-th and 
(n + 1)-th horizontal lines can be read out simul- 
taneously. Thus, the interlace scanning is accom- 
plished by determining combinations of paired 
horizontal lines read out simultaneously within each 
45 filed such that a pair of the n-th and (n + 1 )-th lines, a 

pair of the (n + 2)-th and (n + 3)-th lines, are read 

out within the first field and a pair of the (n-1 )-th and 
n-th lines, a pair of the (n + 1)-th and (n + 2)-th lines, 

are read out within the second field. 

50 As shown in Figure 1 , the photo sensitive elements 
1 such as for example photodiodes are arranged 
two-dimensionally in a semiconductor substrate and 
vertical switching elements 2 including MOS FETs 
are associated with the respective photo sensitive 
55 elements 1 so that photo signals from the respective 
photo sensitive elements 1 can be read out. A 
vertical scanning circuit 3 including a shift register is 
adapted to generate a series of switching pulses 
which are applied to the gate electrode of respective 
60 FET, i.e., the control terminal of the vertical switch- 
ing element 2. Similarly, a horizontal scanning circuit 
4 is adapted to generate a series of switching pulses 
which are applied to the control terminal of respec- 
tive horizontal switching elements 5 arranged in 
65 array. A switchover circuit 6 permits the interlace 



. scanning when controlled by a control pulse genen- 
| ated from a control pulse generator circuit 7 which 
: includes a flip-flop circuit, for example. Reference 
numerals 9 and 1 0 designate output signal lines. The 
70 control pulse generator circuit 7 alternately gener- 
ates pulses to be applied via lines 7a and 7b r 
respectively, to the control terminal of the corres- 
ponding MOS FETs constituting the switchover 
circuit 6. 

75 Figure 2 shows driving pulse wave forms in the 
solid state imaging device shown in Figure 1, 
especially the output wave form of each stage of the 
hroizontal scanning circuit 4 being shown in sections 
. A through C, the output wave form of each stage of 
80 the vertical scanning circuit 3 in sections D through 
F, and the wave forms of the two output pulses from 
the control pulse generator circuit 7 in sections G 
and H, respectively. Under the control of these 
driving pulses, photo signals of the photo sensitive 
85 element arrays on the paired horizontal lines are 
delivered out simultaneously via the output signal 
lines 9 and 10. 

Assume now that a mosaic color filter as shown in 
Figure 3 is disposed in front of the'soiicj state 
90 iamging device. The mosaic color filter has green 
color transmissive filtering counterparts as desig- 
nated at G, red color transmissive filtering couter- 
parts as designated at R and blue color transmissive 
filtering counterparts as designated at B, individual 
95 counterparts being in register with individual photo 
sensitive elements 1 shown in Figure 1 . 

With this mosaic color filter, G and R signals are 
alternately delivered out via the output signal line 9 
while B and G signals being alternately delivered out 
100 via the output signal line 10. A prior art signal 

processing circuit for deriving an NTSC composite 
color signal from the R, G and B signals is exempli- 
fied as shown in Figure 4, and it comprises a 
switchover circuit 11 for switching over the output 
105 lines 9 and 10 in responses each pircture element 
and fetching the G signal successively, a gate circuit 
12 for fetching the R signal on the output line 9 in 
response to one picture element after the other, a 
gate circuit 1 3 for fetching the B signal on the output 
110 line 10 in response to one picture clement after the 
other, processing circuits 14, 15 and 16 for proces- 
sing the G, R and B signals, respectively, a matrix 
circuit 17 for deriving a Y signal indicative of a 
luminance signal and (R-Y) and (B-Y) signals indica- 
115 tive of color difference signals from the R. G and B 
signals, low-pass filters (LPF) 18 and 19, balanced 
modulators 20 and 21 for delivering out (R-Y) cos tot 
and (B-Y) sin cot signals, respectively, an oscillator 
22, a phase shifter 23, a bandpass fitcr 24, and an 
1 20 output terminal 25. As clearly be seen from the 
figure, an NTSC composite color signal can be 
obtained from the output terminal 25. 

The prior art circuit exemplified herein requires 
the balanced modulator 20 and 21 and the proces- 
125 sing circuits 14, 15 and 16 associated with the G, R 
and B signals, resulting in a complicated circuit 
construction and increase in the number of circuit 
parts which prevent cutdown in the manufacture 
cost of the camera. 
130 More particularly, the signal processing circuit of 
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the prior art solid state color imaging apparatus 
comprises a demodulator circuit including the gate 
circuits 11, 12 and 13, the processing circuits and an 
encoder circuit including the circuits 17 and 24. 
5 Among these components, the processing circuits 
and the balanced modulators prevail. Generally, the 
processing circuit includes at least a clamping 
circuit, a blanking signal insertion circuit, and a 
clipper circuit. Moreover, a highly precise tempera- 
10 ture stability is required of.the processing circuit 
which participates in processing of the chrominance 
signal and it is inevitable that the processing circuit 
becomes expensive. In other words, in order to 
prevent temperature instability leading to deviation 
15 of color balance, the construction of the processing 
circuit is highly sophisticated. 

In order to obviate the above drawbacks of the 
prior art solid state color imaging apparatus, the 
present invention contemplates a solid state color 
20 imaging apparatus wherein color video signals 
derived directly from a single solid state imaging 
device can be formed into an NTSC composite color 
signal through only a simplified signal processing, 
and a preferred embodiment thereof will be de- 
25 scribed hereinafter. 

Figure 5 shows a mosaic color filter to be com- 
bined with the solid state imaging device of Figure 1 
in accordance with the invention, and Figure 6 
shows a signal processing circuit which processes 
30 the output signals from the solid state imaging 
device and the mosaic color filter in combination to 
form an NTSC composite color signal. 

The mosaic color filter shown in Figure 5 has 
luminance filtering counterparts as designated at Y 
35 having each a filter spectrum characteristic which 
causes the associated photo sensitive element to 
produce a chrominance signal of an R, G and B 
signal ratio of 0.3R + 0.59G + 0.11B, i.e., a luminance 
signal pursuant to NTSC, red color transmtssive 
40 counterparts as designated at R, and blue color 
transmissive counterparts as designated at B. With 
the color filter as shown in Figure 5, Y and R signals 
on the output line 9 of the solid state imaging device 
of Figure 1 are delivered out alternately in response 
45 to one picture element after the other whereas B and 
Y signals on the output line 10 are delivered out 
alternately in response to one picture element after 
the other. 

According to the present invention, the Y, R and B 

50 filtering counterparts are so adjusted in advance as 
to have each such a transmittivity that the magni- 
tudes of the Y, R and B signal outputs are identical 
when a black and white object is picked up. In 
addition, the horizontal clock pulse being delivered 

55 out from the horizontal scanning circuit 4 of the solid 
state imaging device shown in Figure 1 is so 
designed as to have a frequency which is twice the 
frequency f s of the chrominance subcarrier con- 
tained in the NTSC composite color signal. Thus, for 

60 the frequency f s being 3.58 MHz, the frequency of the 
horizontal clock pulse is 7.1 6 MHz. 

The signal processing circuit shown in Figure 6 
comprises a switchover circuit 52 for fetching the Y 
signal on the output lines 9 and 10 alternately in 

65 response to one picture element, a low-pass filter 



(LPF) 35, bandpass filters (BPF) 36 and 37, a phase 
shifter 38, coefficient units 39 and 40, a signal 
inverter circuit (INV) 41 , a switching circuit 42, an 
NTSC composite color signal output terminal 43, a 
70 processing circuit for Y signal 51, and adder circuits 
53, 54 and 55. 

The bandpass filters 36 and 37 pass therethrough 
only a band component of 3.58 MHz ± 500 KHz. 
Since the Y and R signals appear alternately on the 
75 output line 9 in accordance with the arrangement of 
the Y and R filtering counterparts, a color difference 
signal of (R-Y) cos cot which varies at 3.58 MHz can be 
obtained when a colored object is picked up. On the 
other hand, the Y and B signals appear alternately on 
80 the output line 10. Since the position of the Y filtering 
counterparts is shifted by one picture element from 
that of the Y filtering counterpart contained in the 
former arrangement of the Y and R filtering counter- 
parts, the output signal developing on the output 
85 line 10 is out of phase by rc with respect to the signal 
on the output line 9, turning into a color difference 
signal of - (B-Y) cos art varying at 3.58 MHz. 

The phase shifter 38 shifts the phase of the (R-Y) 
cos cot signal by jc/2 to thereby obtain the norma! 
90 carrier chrominance signal pursuant to the NTSC 
system so that the phase difference between the 
(R-Y) cos art and -(B-Y) cos cot signals can be Jt/2. 

Due to the fact that the transmittivity of each 
filtering counterpart is designed in advance such 
95 that Y = R - B holds, the two color difference signals 
are zero when a black and white object is picked up 
and accordingly, stand for the chrominance subcar- 
rier subject to the balanced modulation. These 
signals are fed to the adder circuit 53 via the 
100 coefficient units 39 and 40, respectively, and synthe- 
sized at the adder circuit 53 at a predetermined ratio. 

It is to be noted that since the chrominance 
subcarrier frequency is made an odd multiple of the 
horizontal scanning frequency in the NTSC system, it 
105 is necessary to invert the phase of the chrominance 
carrier by 180° at the termination of one horizontal 
scanning period (1H). However, with the color filter 
shown in Figure 5, each horizontal scanning always 
starts from the Y or B filtering counterpart, thereby 
.110 ensuring that the chrominance subcarrier delivered 
out from the adder circuit 53 can take the same 
position within each horizontal scanning period. 
Therefore, according to the circuit of Figure 6, the 
switching circuit 42 is so designed as to operate each 
115 time 1H terminates and the chrominance subcarrier 
subject to phase inversion at the phase inverter 
circuit 41 is allowed to be fed the adder circuit 54. 

The adder circuit 54 adds the chrominance subcar- 
rier signal to the luminance signal having been 
120 passed through the switchover circuit 52, low-pass 
filter 35 and processing circuit 51 . The output signal 
of the adder circuit 54 is further added with the 
synchronizing signal SYNC and color burst signal at 
the adder circuit 55, thereby producing an NTSC 
125 composite color signal on the output terminal 43. 
As will be seen from the foregoing description, 
according to the appratus of this embodiment, the 
signals appearing on the output lines 9 and 10 are 
removed of other components than the carrier 
130 (chrominance subcarrier) component after passed 
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through the BPFs 36 and 37. Therefore, there is no 
need of providing the balanced modulator and the 
processing circuit as well. The signals having passed 
through the BPFs 36 and 37 are removed of DC 
5 component, eliminating the necessity of fixing the 
DC component. The processing circuit 51 is neces- 
sary which fixes the DC component of the Y signal. 
This processing circuit, however, can be inexpensive 
and can sufficiently be simplified since it has nothing 
10 to do with the color component and never affects the 
color balance. 

Figure 7 shows a second embodiment of the 
present invention wherein the white balance (carrier 
balance) is adjusted electrically and in contrast to the 
1 5 previous embodiment, there is no need of optically 
designing the interrelation between transmittivities 
of filtering counterparts of the mosaic color filter. In 
Figure 7, circuit components corresponding to those 
of the first embodiment are designated by the same 
20 reference numerals. Gate circuits 31, 32 33 and 34 
fetch signals on output lines 9 and 10 alternately in 
response to one picture element, i.e., at a frequency 
of 7.16 MHz and delivered out R and Y signals and B 
and Y signals successively. The white balance is 
25 adjusted in coefficient units 47, 48, 49 and 50. 
Ft and Y signals and B and Y signals are then 
applied to the band-pass filters 36 and 37 through 
adder circuits 60 and 61, respectively. An oscillator 
44 generates a frequency of 7.16 MHz, a frequency 
30 divider 45 performs a 1/2 frequency division and an 
inverter circuit 46 inverts the signal. The luminance 
signal is obtained by adding the signals on the 
output lines 9 and 10 at an adder circuit 52' and for 
this reason, in this embodiment, an accurate lumi- 
35 nance signal meeting the NTSC system cannot be 
obtained but the resolution can be improved. A 
processing circuit 51 is exclusively adapted to pro- 
cess the luminance signal and in accordance with 
the invention, the color signal system does not 
40 require the processing circuit. In this embodiment, 
the switchover circuit 52 of Figure 6 may be substi- 
tuted for the adder circuit 52' for the sake of 
obtaining the luminance signal. 

In place of the mosaic color filter as shown in 
45 Figure 5, a mosaic color filter as illustrated in Figure 
8 may be used to implement the present invention. 
The color filter of Figure 8 has cyan color transmis- 
sive filtering counterparts as designated at C y and 
yellow color transmissive filtering counterparts as 
50 designated at Y e . Needless to say, C v signal and Y 0 
signal are equivalent to (G + B) signal and (Ft + G) 
signal, respectively. 

With the color filter of Figure 8, the C Y signal 
develops on the output line 9 in place of the R signal 
55 and the Y e signal develops on the output line 10 in. 
place of the B signal. Then, these C Y and Y c signals 
are processed through a signal processing circuit 
similar to that of Figure 6 or Figure 7 to form an 
NTSC composite color signal. In this case, in contrast 
60 to the first and second embodiments, the phase of 
the color burst signal which acts as the reference 
phase is inverted by 1 80°. It will be appreciated that, 
in the circuits of Figures 6 and 7, the color burst 
signal is inserted in a stage subsequent to the 
65 switching circuit 42. 



As having been described, in the invention can; 
j provide the NTSC composite color signal without 
relying on the sophisticated signal processing and 
greatly contribute to miniaturization and inexpen- 
70 siveness of the color television camera. 

CLAIMS 

1 . In a solid state color imaging appartus com- 

75 prising: 

a plurality of photo sensitive element arrays 
arranged horizontally and vertically; 

a signal reading out circuit scanning the plurality 
of photo sensitive element arrays with parallel 

80 scanning of the photo sensitive element arrays 

arranged on sets of two horizontal lines and deliver- 
ing photo signals from the photo sensitive elements 
to first and second output circuits associated with 
the two horizontal lines of the respective sets; 

85 a mosaic color fitler having luminance filtering 
counterparts arranged horizontally and vertically 
one after the other and first and second filtering 
counterparts arranged at the remaining positions of 
the mosaic arid on alternate horizontal lines, each of 

90 the filtering counterparts being in register with each 
of the photo sensitive elements; and 

a signal processing circuit for converting the 
signals developing on the first and second output 
circuit into a composite color signal combined with a 

95 chrominance subcarrier, 

the improvement wherein said signal reading out 
circuit includes means for scanning the plurality of 
photo sensitive element arrays at a horizontal clock 
frequency which is twice the chrominance subcarrier 
1 00 frequency, whereby a first color difference signal 

between a first chrominance signal corresponding to 
the first filtering counterpart and a luminance signal 
is delivered to the first output circuit whereas a 
second color difference signal between a second 
105 chrominance signal corresponding to the second 
filtering counterpart and the luminance signal is 
delivered to the second output circuit, said first and 
second color difference signals varying at the same 
frequency as the chrominance subcarrier frequency; 

110 and 

wherein said signal processing circuit includes 
bandpass filters respectively connected to the first 
and second output circuits, first means for shifting 
by x/2 the phase of the output signal from one of the 

115 bandpass filters and adding the phase-shifted signal 
to the output signal from the other bandpass filter, 
second means forfetching a luminance signal 
component from the first and second output circuits, 
and third means forforming a composite color 

120 signal from the outputs of the first and second 
means and a synchronizing signal. 

2. A solid-state color imaging apparatus accord- 
ing to Claim 1 wherein said first means comprises a 
phase shifter circuit for shifting by jt/2 the phase of 

125 the output signal of the bandpass filter, a first 
coefficient unit for attenuating the output of the 
phase shifter circuit at a predetermined ratio, a 
second coefficient unit for attenuating the output of 
said other bandpass filter at a predetermined ratio, 

130 and an adder circuit for adding the outputs of the 



two coefficient units. 

3. A solid state color imaging apparatus accord- 
ing to Claim 1 or 2 wherein said third means 
comprises a low-pass filter connected to the second 

5 means, a processing circuit connected to the low- 
pass filter, a circuit for inverting and delivering the 
output signal of the first means when each one 
horizontal period terminates, and a circuit for com- 
bining the outputs of the processing circuit and 
10 inverting circuit with the synchronizing signal. 

4. A solid state color imaging apparatus accord- 
ing to Claim 1, 2 or 3 wherein said mosaic colorfilter 
comprises the luminance filtering counterparts, first 
filtering counterparts and second filtering counter- 

15 parts having their light transmittivities which couse 
the corresponding photo sensitive elements to pro- 
duce the photo signals of the same magnitudes 
when a black and white object is picked up. 

5. A solid state color imaging apparatus accord- 
20 ing to Claim 1, 2 or 3 wherein said signal processing 

circuit comprises means for separating the signals of 
the first and second output circuits into signals . 
associated with the respective photo sensitive ele- 
ments, means for adjusting the white balance be- 

25 tween two signals separated from the output of the 
first output circuit and adding the two signals, and 
means for adjusting the white balance between two 
signals separated from the output of the second 
output circuit and adding the two signals, the output 

30 signals of the adder means being applied to the 
bandpass filters. 

6. A solid state color imaging apparatus substan- 
tially as hereinbefore described with reference to 
and as illustrated in Figures 5 to 8 of the accompany- 

35 ing drawings. 
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